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(54) Volume rendering pipeline 

(57) A volume rendering pipeline includes a plurality 
of processing stages such as a gradient estimation 
stage, an interpolation stage, a classification stage, an 
illumination stage, and a compositing stage. The stages 
are connected to each other by multiplexers. A first mul- 
tiplexer connects an output of a first stage to an input of 
a second stage. A second multiplexer connects an out- 
put of the second stage to an Input of the first stage, A 
third multiplexer has inputs connected to the output of 
the first stage and the output of the second stage, the 
first, second, and third multiplexers are responsive to a 
select signal to configure the stages of the rendering 
pipeline for processing the volume data set. 
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Description 

FIELD OF THE INVENTION 

[0001] This invention relates generally to volume ren- 5 
dering, and more particularly, to a rendering pipeline 
wherein the order of processing in the pipeline stages 
can be user selectable. 

BACKGROUND OF THE INVENTION 10 

Introduction to Volume Rendering 

[0002] Volume rendering is often used in computer 
graphics applications where three-dimensional data 15 
need to be visualized. The volume data can be scans of 
physical or medical objects, or atmospheric, geophysi- 
cal, or other scientific models where visualization of the 
data facilitates an understanding of the underlying real- 
wortd structures represented by the data. 
[0003] With volume rendering, the intemal structure, 
as well as the external surface features of physical ob- 
jects and models are visualized. Voxels are usually the 
fundamental data items used in volume rendering. A 
voxel is a data item that represents a particular three- 
dimensional portion of the object or model. The coordi- 
nates (x, y, z) of each voxel map the voxels to positions 
within the represented object or model. 
[0004] A voxel represents some particular intensity 
value of the object or model. For a given prior an volume, 
intensity values can be a specific one of a number of 
different parameters, such as, density, tissue type, elas- 
ticity, or velocity. During rendering, the voxel values are 
convened to color and opacity (RGB ) values, according 
to the intensity values, which can be projected onto a 
two-dimensional image plane for viewing. 
[0005] One frequently used technique during render- 
ing is ray-casting. A set of imaginary rays are cast 
through the array of voxels. The rays originate from a 
viewer's eye or from an image plane. The voxel values 
are re-sampled to points along the rays, and various 
techniques are known to convert the sampled values to 
pixel values. Altematively, voxel values may be convert- 
ed directly to RGB voxels, which are then re-sampled 
along rays and accumulated to pixel values. In either 
case, processing of the volume data may proceed back- 
to-front, or front-to-back. 

Rendering Pipeline 

[0006] Volume rendering can be done by software or 
hardware. In one hardware implementation, the hard- 
ware is arranged as a multi-stage pipeline, see U.S. Pat- 
ent Application 09/190,643 "Fast Storage and Retrieval 
of Intermediate Values in a Real-Time Volume Render- 
ing System," filed by Kappler et al. on Nov. 12, 1998. 
[0007] Figure 1 illustrates a pipeline 100 wherein vox- 
el values are stored in a voxel memory 101. The voxel 



values are first read into a voxel buffer 110 of the pipeline 
as slices. The z-components of the gradients are esti- 
mated in stage 115 by taking central differences be- 
tween voxels of different slices. Then, both the voxel val- 
ues and the z-gradients are passed to an interpolation 
stage 1 20 that calculates these values at sample points 
along rays. Next, the x- and y-components of the gradi- 
ents are calculated from the interpolated sample values 
in stage 130. These, along with the sample values and 
the interpolated z-gradients are then passed to a clas- 
sification stage 140, and then a shading stage 145, 
where an illumination process is applied to produce the 
RGB values representing the illuminated samples. Fi- 
nally, the illuminated samples are combined along rays 
in an compositing stage 150 to produce pixel values for 
the base plane stored in a pixel memory 109. 
[0008] That pipeline structure suffers because the or- 
der of processing data is fixed by the arrangement of 
the various stages. Also, voxel values are interpolated 
so that only interpolated samples can be classified. It is 
not possible to concunrently render multiple volumes ac- 
quired from different scanning modalities. In addition, 
the format of the voxel data is fixed. Gradient fields are 
obtained from the fixed format voxel data. It is desired 
to improve on this prior art pipeline. 

SUMMARY OF THE INVENTION 

[0009] The invention provides a volume rendering 
pipeline including a plurality of processing stages. The 
stages can include a gradient estimation stage, an in- 
terpolation stage, a classification stage, an illumination 
stage, and a compositing stage. The stages are con- 
nected to each other by multiplexers. 
[001 0] A first multiplexer connects an output of a par- 
ticular stage to an input of another stage, and a second 
multiplexer connects an input of a particular stage to an 
output of another stage. The multiplexers selectively 
connect the stages of the pipeline in a predetermined 
order to configure the rendering pipeline for processing 
a volume data set. 

[0011] In one aspect of the invention, voxels of the 
volume data set are interpolated before classified, and 
in another aspect, the voxel are interpolated before they 
are classified. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] 

Figure 1 is a block diagram of a prior art rendering 
pipeline; 

Figure 2 is a block diagram of a configurable ren- 
dering pipeline; 

Figure 3 is a pipeline with interpolation before clas- 
sification; 
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Figure 4 is a pipeline with classification before in- 
terpolation; 

Figure 5 is a block diagram of a flexible fomnat voxel. 

5 

Figure 6 Is a block diagram of a field format register; 

Figure 7 is a block diagram of a voxel format regis- 
ter; 

10 

Figure 8 Is an example formatted voxel; 

Figure 9 is a block diagram of a configurable ren- 
dering pipeline connected to a volume memory. 

15 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

[001 3] Figure 2 shows a top-level block diagram of a 
configurable rendering pipeline 200 according to the in- 20 
vention. The pipeline 200 takes samples or voxels as 
Input from a voxel memory 201 , and stores pixels as out- 
put in a pixel memory 209. The voxels or samples are 
read into a voxel buffer 210 a volume slice at the time. 
Gradients are estimated for xyz-components in stage 25 
220. Here, in contrast with the prior art, all gradient com- 
ponents are estimated on voxel or sample values, not 
on interpolated samples. 

[0014] The voxels 221 are classified in stage 230. In- 
terpolation of voxels and gradients takes place in stage 30 
240. Gradient estimation and interpolation are linear op- 
erations and therefore can be interchanged. As an ad- 
vantage of the invention, the application can determine 
the order in which the voxels and gradients are proc- 
essed by the various stages. The reason for two differ- 35 
ent processing orders is a follows. 
[0015] Scanners acquire sampled data by making 
physical measurements which typically represent an in- 
tegral over a small region of space. Adjacent voxels of- 
ten represent the integrals of overlapping regions. In 40 
these cases, it is more accurate to interpolate voxels 
first, then classify the result. In particular, a voxel at a 
boundary of, say, two different tissues is likely to repre- 
sent an average of the physical properties of each tis- 
sue. When interpolating, all that is done is moving the 45 
points of average. To make this useful, the classification 
function should present a continuous transition from be- 
tween the colors and opacities assigned to the two tis- 
sue types. 

[0016] Sometimes, sampled data may be pre-seg- so 
mented (manually or automatically) into distinct materi- 
als, e.g., bone, muscle, cartilage, etc. Given such data, 
it would be inappropriate to interpolate between two dif- 
ferently identified tissues to obtain a third tissue that is 
not really there. In these cases, it is better to classify the 55 
voxels first, then interpolate the resulting colors. This is 
not so much an average of the physical properties of 
adjacent tissue types, but rather a blend of the colors at 



their boundaries. 

[0017] Therefore, the pipeline 200 includes a multi- 
plexer 251 connecting the output from stage 240 to the 
input of stage 230. Similariy, a multiplexer 252 connects 
the output of stage 230 to the input of stage 240. Multi- 
plexer 253 selects the output from either stage 230 or 
stage 240. 

[001 8] The order of connection of the stages depends 
on a selection signal (GCI/GIC) 202 to the three multi- 
plexers 251-253. In either case, interpolated gradients 
and interpolated samples are passed to the illumination 
stage 260. Illuminated RGB values are composited in 
stage 270, and output pixels 271 are stored in the pixel 
memory 209. 

[0019] In the pipeline 200, the output of the gradient 
estimate stage 220 Is the three components of gradi- 
ents. These are passed to both the classification stage 
and the interpolation stage through the set of multiplex- 
ers. The output of each of these stages is each passed 
to the input of the other stage and also to the illumination 
stage 260 through another multiplexer. 
[0020] By appropriately selecting the three multiplex- 
ers 251-253, it is possible to do classification before in- 
terpolation, or interpolation before classification, or only 
interpolation, or only classification. These different 
modes of operation is now described in greater detail. 

GIC — Gradient Interpolation, Classification 

[0021] Figure 3 illustrates the rendering process for 
the GIC mode. This mode can be selected by signal 202. 
In the GIC mode, gradients are first estimated, then in- 
terpolation takes place on gradients and voxels in par- 
allel, followed by classification of the voxels. 
[0022] Rendering proceeds a section at a time, that 
is, in groups of 32x32 rays. In order to process a section 
of rays, slices of voxels are read into the voxel buffer 
210 two slices at the time. Each slice has only the voxels 
needed for that section. The number of voxels per slice 
depends upon the view direction and resampling fre- 
quency. The maximum number of voxels needed is 
37X37 voxels. 

[0023] Reading voxels into the voxel buffer 210 can 
consumes the full bandwidth of the destination slices. 
Therefore, at any given time, one pair of slices is dedi- 
cated to receiving new voxels, while another two pairs 
of slices are dedicated to supplying the next stages of 
the pipeline, i.e., the gradient estimation 220 and the 
voxel interpolation stages 240. 
[0024] In Figure 3, slices labeled s+1 and s +2 are 
receiving new voxels, while slices s, s-1, and s-2 are 
providing voxels to the subsequent stages. Slice s-3 
was used during a previous slice and is cun-ently empty. 
When the processing of slice s-2 is complete, slice s-2 
is also marked as empty. Then, slices s-2 and s-3 will 
become the new destination for voxel reads, while the 
processing modules will start taking their input from slic- 
es s +1, s, and s-1. 
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[0025] The gradient estimation stage 220 estimates 
gradients at voxel points in slice s-1 from voxel values 
In slices s and s-2. These gradients are then stored in 
a two slice gradient buffer 225 for interpolation by unit 
228. Gradients for voxel points In slice s-2 had been 
stored In the gradient buffer during a previous slice Iter- 
ation. 

[0026] Next, voxel interpolation 240 and gradient in- 
terpolation 228 proceed concun-ently. That is, a slice of 
samples is obtained by interpolating voxel values from 
voxel slices s -1 and s -2. Gradients at a sample points 
in the current slice of samples are obtained by interpo- 
lating the gradients of gradient slice s -1 and gradient 
slice s -2 in the gradient buffer. More than one slice of 
samples and interpolated gradients can be obtained 
from the same pair of voxel and gradient slices. 
[0027] The interpolated voxel values are next applied 
to the classification stage 230, which converts the val- 
ues to Interpolated RGBa color values. The RGBa val- 
ues and the gradients are next supplied to the Illumina- 
tion stage 260, and finally to the compositing stage 270. 
[0028] In an optional mode, gradients are extracted 
directly from, for example, three voxel fields, instead of 
using the gradient estimation stage 220 to estimating 
gradients from any voxel field. 

GCI - Gradient, Classification, Interpolation 

[0029] Figure 4 illustrates the rendering algorithm for 
the GCI mode, also selected by signal 202. The voxel 
buffer 210 is filled as described above, and the gradient 
estimation process is also the same. The difference is 
In the voxel classification and interpolation side. In par- 
ticular, raw voxels are taken from the voxel slice buffer, 
that is slice s-1, and immediately converted to RGBa 
values by the classification stage 230. These are then 
stored in a two slice RGB buffer 235. Note, the RGB 
buffer 235 is parallel to the two slice gradient buffer 225. 
[0030] The two slices are then Input to the RGB inter- 
polation stage 240, where interpolated RGB values are 
produced in parallel with Interpolating gradients. These 
are then applied with interpolated gradients to the Illu- 
mination and compositing stages to produce the pixel 
output 271 of the base plane image. These last two mod- 
ules are identical to those of Figure 2-3. 
[0031] One additional optional mode Is also possible. 
In this optional mode, multiple, for example, four, fields 
of the voxel are interpreted as raw RGB values. In this 
case, the gradient may be estimated from the alpha ( ) 
field. 

[0032] It should be noted that for some volume data 
sets and rendering modes it may be best to estimate 
gradient in a later stage of the pipeline, for example, af- 
ter classification. 

[0033] It should be apparent that the multiplexers 
251-253 can be replicated for other stages. Stages can 
selected and connected in a number of different orders 
to provide a reconfigurable rendering pipeline. Some 



stages can be de-selected to not process the volume 
data at all. for example, for some renderings gradient 
estimation and illumination may be skipped. 

5 Flexible Voxel Format 

[0034] As shown in Figure 5, a voxel 500 as used by 
the configurable rendering pipeline 200 Includes a plu- 
rality of fields (V^ V„) 501-209. Each of the fields 

10 501-209 can be specified as an offset and width in the 
voxel 500. Any of the fields can overlap as shown for 
fields and V2. The fields can be enumerated in any 
order. 

[0035] The fields describe different attributes of a rep- 

15 resented three-dimensional object or model. For exam- 
ple, if the object is a human head, then the fields 
501-209 can respectively store intensity values ac- 
quired from CT, MRI, PET. SPECT, and ultrasound 
scans, i.e., each voxel may store five different scan In- 

20 tensity values in a single volume representation. Alter- 
natively, the scans can be stored as multiple separate 
volumes wherein each voxel contributes one field. 
[0036] Some fields can be category fields related to 
the way the volume Is segmented, e.g., manual, seml- 

25 automatic, or automatic segmentation. In medical appli- 
cations, segmentation can categorize bone, tissue, etc., 
In physical applications, segmentation can identify sub- 
assemblies or other parts to be rendered in a particular 
way. For physical models, the fields can store state var- 

30 iables used in scientific visualization, e.g., pressure, ve- 
locity, angular momentum, elasticity, density, tempera- 
ture, and viscosity. For any volume data set, the fields 
can also store RGB values, depth, 3D stencil, shadows, 
fog, voxelized and embedded geometry volumes, or 

35 gradients. 

[0037] For a multi-field voxel 500 according to our in- 
vention, the user can specify which fields to use for gra- 
dient calculations. For each component of the gradient, 
we can specify which of the voxel fields to use for that 

40 cx»mponent. 

[0038] For multi-field visualization, it Is usually desir- 
able to interpolate fields within voxels separately. Fur- 
thermore, each field within the voxel can have a different 
interpolation function applied, e.g., tri-linear for Intensity 

45 fields, and nearest neighbor interpolation for category 
fields. The flexible voxels as described herein enable a 
common framework for treating all special cases of vox- 
el formats In a unifomi fashion. 

50 Field Format Register 

[0039] Figure 6 shows a field fomnat register 600 that 
enables multiple field voxels according to the invention. 
In one embodiment, fields of voxels are defined by de- 
55 scriptors of the field fomriat register. This is an 8-bit (7: 
0) descriptor defining the size of the field (in 4-bit nib- 
bles) 610, the position of the field within its voxel 620, 
pixel (also in 4-bit nibbles), and what to do (control 630) 
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when the field is a different size than specified for its 
intended use. 

[0040] The control bits define how a field may adapted 
to fit the data path of the pipeline through which the field 
will pass. The field can be changed by repeating fraction 
arithmetic, or by adding or removing bits from either the 
most significant or least significant end. 
[0041] Control = 0: the field of the raw voxel is treated 
as an unsigned repeating fraction representing a 
number In the range [0...1]. To expand or shrink the re- 
peating fraction to fit the data path, repeating fractional 
arithmetic is applied to scale and round, thereby repre- 
senting the number with fewer or more bits of preces- 
sion. Repeating fraction number representation is de- 
scribed in greater detail below. 
[0042] Control = 1 : the field of the voxel Is treated as 
a signed repeating fraction in the range 
[0043] Control = 2: the field of the raw voxel is ex- 
panded or truncated in its least significant bits to fit the 
data path. The most significant bits are preserved. 
[0044] Control = 3: the field of the raw voxel is ex- 
panded or truncated in its most significant bits to fit the 
data path. The least significant bits are preserved. 

Repeating Fraction Number Representation 

[0045] Many graphics applications use a fixed width 
binary number to represent color, transparency, or other 
parameters that have values in the range zero to one, 
inclusive. 

[0046] Let R be the number of bits In the binary 
number and let V be the unsigned binary value stored 
in these bits. Then F = W (2^ - 1) '\sa rational number 
in the range [0,.1]. That is, when \/ equals zero, F equals 
zero, and when \/ equals Its largest possible value, (2^ 
- 1),F equals one. This representation is well known in 
the prior art. For example, the OpenGL Specification re- 
fers to it as a special kind of fixed point representation. 
[0047] To clearly distinguish the representation de- 
scribed herein from ordinary fixed point representation, 
the temn "repeating fractions" is used. The name temn 
derives from the fact that expanding F Into a fixed point 
binary fraction produces O.VVWW..., that is, a binary 
fraction that repeats the R-bit value V infinitely to the 
right of the binary point. 

[0048] Repeating fractions can be represented with 
more than R bits and can even be signed. In that case, 
R is the "repeating precision" of the number, since R de- 
fines the implicit scale factor (2^ - 1). This allows F to 
have values outside the range [0...1]. in this case, the 
binary fixed point representation consists of an integer 
value followed by an R-bit infinitely repeating binary val- 
ue. Repeating fractions with the same precision may be 
added and subtracted in the same way as ordinary in- 
tegers. 

[0049] Other arithmetic operations, including chang- 
ing the repeating precision, may be performed by first 
computing Ffor each repeating fraction, performing nor- 



mal arithmetic, and then multiplying the resulting value 
by (2^ - 1) for the repeating precision R of the result. 
More efficient fonns exist for operations on repeating 
fractions. For example, doubling the repeating precision 
5 from R to 2R simply requires computing V + (V< <R), 

Voxel Formats 

[0050] The pipeline according to the Invention allows 
10 a wide range of in put formats of voxels. Input voxels can 
be 8, 16, 32, or larger bit quantities. Fields can be 4, 8, 
12, or 16 bits in width, and are aligned on a 4-bit bound- 
ary within the voxel. All voxels fields are scaled to fit their 
data paths, which are typically twelve bits wide. 
15 [0051] The format of a voxel is described in a voxel 
fomriat register 700. An example of the format of a 32-bit 
voxel 800 is illustrated in Figure 8. In Figure 7, the format 
register for the example voxel, FieldO occupies bits 11 : 
0, Fieldl occupies bits 23:20, Field2 occupies bits 31: 
20 24, and Fields overiaps FieldO and occupies bits 15:8. 
For the example shown in Figure 8, the descriptions of 
the fields in field format register are as follows: 

Field3: Size = 1 Position = 2, 
25 Field2: Size = 1 Position = 6, 

Fieldl: Size = 0 Position = 5, and 
FieldO: Size = 2 Position = 0. 

Advantages 

30 

[0052] Having flexible format voxels, and a reconfig- 
urable pipeline enable a number of advantages. For ex- 
ample, one of the fields in a voxel can be used for cat- 
egory bits. These are extra bits in voxels that identify 

35 the voxel as part of some particular tissue, sub-assem- 
bly, or other partition of the volume. They are not inter- 
polated, but they do contribute to the assignment of 
RGB values to voxels. When category bits are used, 
classification usually precedes interpolation. 

40 [0053] The flexible voxel fomnat allows gradients to be 
estimated from any selected field of the voxel. In these 
cases, a convolution kernel, such as a central differ- 
ence, is applied to the selected field of each voxel to 
obtain the x, y, and z-components of the gradient of that 

45 voxel. These gradients are then interpolated, in parallel 
with raw or classified voxels, in order to obtain gradients 
at sample points. These are then applied, along with 
RGB values to the illumination stage 260, and finally to 
the compositing stage 270. 

50 [0054] In some applications and for some volumes, it 
may be better to use gradients that are determined in 
some other manner, instead of estimating them from the 
fields of voxels on the fly. Flexible format voxels accom- 
modate this mode. In particular, gradients may be 

55 precomputed for the voxels with a high level of precision. 
These precomputed gradients can be stored in one of 
the fields of the voxels. These precomputed gradients 
can bypass the estimation stage, but are interpolated 
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and applied in the illumination stage 260 just as the gra- 
dients estimated on the fly. 

[0055] In a further variation, precomputed gradient 
are applied to a convolution kernel for gradient estima- 
tion. This has the effect of taking the second partial de- 
rivative of the volume data set. By the same technique, 
higher order partial derivatives may be obtained. Such 
derivatives are useful for extracting weak surfaces in the 
volume data set. As described for Figure 9 below, this 
can be done by passing the volume data set through the 
pipeline (1-3) multiple times in a "multi-pass" operation. 
Each pass processing the volume data set with different 
set of rendering parameters. 

[0056] The pipeline 200 processing flexible format 
voxels also admits volume data sets that are preclassl- 
fied and presented as "RGB " voxels. Two alternatives 
are useful. In one, gradient estimation and the classifi- 
cation and shading are be skipped entirely, and the vox- 
els simply interpolated. In the other alternative, gradi- 
ents are estimated from alpha values or a luminance 
function, and shading the RGBa values is done accord- 
ing to the illumination function. Note, the pipeline 200 
according to the Invention is also capable of interpolat- 
ing both voxel-gradient values and RGB values. 

Multi-pass Volume Rendering 

[0057] The rendering pipeline 200 can also write out 
a volume data set that has passed through some, but 
not necessarily all. of the stages of the pipeline 200 back 
to the voxel memory, see Figure 9. In an example use, 
the configured pipeline renders a set of voxels into RG- 
Ba values. Instead of composited along rays, the RGBa 
values are stored back to the memory 201 as RGBa vox- 
els in a three-dimensional voxel array. Then, the volume 
is rerendered with a different set of rendering parame- 
ters. This process can repeat until a final volume is 
present in memory 201 . The final accumulated values 
are then rendered one final time to generate an Image 
in the pixel memory 209. 

[0058] This technique enables a number of features, 
such as fast resampling. With fast resampling, the vol- 
ume data set can be resampled to a different resolution 
using the speed and power of the volume rendering 
pipeline and volume memory, instead of relying upon the 
host processor and software. 
[0059] Multi-pass rendering can be used to produce 
complex shadows on the volume. One pass is needed 
for each light source. Each pass is accumulated in the 
output volume data set, and then a final pass interpo- 
lates the results and projects them onto the base plane. 
In multi-pass rendering, the volume data set output from 
a current pass is combined with an already existing vol- 
ume data set in the memory. This sometimes requires 
a read-modify-write operation rather than a simply write 
operation. 



Multi-Channel Rendering 

[0060] The pipeline 200 can also process multi-chan- 
nel data sets. Some scanning techniques, such as, ul- 

5 trasound and seismic applications, have data of more 
than one type, each with its own classification. During 
rendering these data sets are be superimposed on each 
other, and combined, voxel-by-voxel. 
[0061] More particulariy, the compositing stage 270 Is 

10 able to operate in either of two modes. In a first mode, 
the RGBa values are combined with previously stored 
pixel values, and in a second mode, a ray of RGBa val- 
ues is accumulated, and the result is combined with a 
previously stored pixel value from some previous pass. 

15 

Pipeline General Structure 

[0062] Generally, the relation of the pipeline 200 and 
the memory 201 can be as shown in Figure 9. Here, the 

20 stages {stage^y stage^ stage„) 1-3 of the pipeline 
200 are connected to each other by multiplexers 4 so 
that for a particular rendering application, the stages are 
ordered by a select signal 5. The Input to the pipeline is 
a raw volume data set stored in a memory 6. The output 

25 of the pipeline is a modified volume data set. Individual 
data items of the volume data set passed between the 
pipeline and the memory are flexible format voxels 7. 
The volume data set can be processed by multiple pass- 
es. 

30 [0063] It is to be understood that various other adap- 
tations and modifications may be made within the spirit 
and scope of the Invention. Therefore, it is the object of 
the appended claims to cover all such variations and 
modifications as come within the true spirit and scope 

35 of the invention. 



Claims 

40 1 . A volume rendering pipeline including a plurality of 
stages for rendering a volume data set, comprising: 

a first multiplexer connecting an output of a first 
stage to an input of a second stage; 

45 a second multiplexer connecting an output of 

the second stage to an Input of the first stage; 
a third multiplexer having inputs connected to 
the output of the first stage and the output of 
the second stage, the first, second, and third 

50 multiplexers responsive to a select signal for 

selecting an order of processing of the volume 
data set through the first and second stages. 

2. The pipeline of claim 1 wherein the plurality of stag- 
55 es includes a gradient estimation stage, Interpola- 
tion stage, classification stage, iilumtnation stage, 
and compositing stage 
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3. The pipeline of claim 2 wherein the select signal 
connects the interpolation stage before the classi- 
fication stage. 

4. The pipeline of claim 2 wherein the select signal 5 
connects the classification stage before the interpo- 
lation stage. 

5. The pipeline of claim 1 wherein a gradient interpo- 
lator using a gradient buffer operates in parallel with io 
a RGB interpolator using a RGB buffer. 

6. The pipeline of claim 1 wherein the first, second, 
and third multiplexers bypass a particular stage of 
the pipeline. 15 

7. The pipeline of claim 1 further comprising: 

a memory, connected to a first stage and last 
stage of the pipeline, the memory storing the 20 
volume data set before and after processing by 
the pipeline. 

8. The pipeline of claim 1 wherein the memory stores 

a rendered image. 25 

9. The pipeline of claim 1 wherein the volume data set 
includes a plurality of voxels, each voxel including 
plurality of fields. 

30 

10. The pipeline of claim 9 wherein each field has an 
associated offset and a width in the voxel. 

11. The pipeline of claim 9 wherein a particular field 
stores a volume category. 35 

12. The pipeline of claim 9 wherein each field is inter- 
polated according to different associated interpola- 
tion function. 

40 

13. The pipeline of claim 2 wherein the gradient estima- 
tion stage extracts gradient components from a par- 
ticular voxel having a plurality of fields. 

45 



50 
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